Attorney Docket: 042390.P13584 



APPLICATION FOR UNITED STATES PATENT 



METHOD TO ESTIMATE POWER AND COOLING REQUIREMENTS 

OF SYSTEMS 



Prepared by: Blakely Sokoloff Taylor & Zafman LLP 
12400 Wilshire Boulevard, 7th Floor 
Los Angeles, California 90025 
Phone: (206) 292-8600 
Facsimile: (206) 292-8606 



CERTIFICATE OF MAILING via EXPRESS MAIL 



I hereby certify that this paper or fee is being deposited with the United States Postal Service "Express Mail Post Office to 
Addressee" service under 37 CFR § 1.10 on the date indicated above and addressed to the Assistant Commissioner for 
Patents, Box Patent Application, WasJimgton, D.C. 2023 1 . 



Inventor: Devadatta V. Bodas 



Rimma N. Oks 



"Express Mail" Label 




!62051335US 



Date of Deposit December 13, 2001 



Date 



METHOD TO ESTIMATE POWER AND COOLING REQUIREMENTS OF 



SYSTEMS 



TECHNICAL FIELD 

This disclosure relates generally to power consumption of electronic 
5 devices, and in particular, but not exclusively, relates to a method of determining the 
power consumption of a computer system. 

BACKGROUND 

Data centers are facilities designed to house large amounts of electronic 
equipment — including devices such as computers, servers and routers — in a central 
10 location. Data centers are vital nodes in information superhighway. Data centers are 
M designed to not only provide all the servers, storage systems and networking 
Q infrastructure required to support incoming data requests, but to also provide services 
such as: authentication, security, and RAS (reliability availability serviceability) 
*; management. Most often, data centers are large rooms that are closed off and heavily air- 
15 03 conditioned to maintain a suitable operating temperature for the equipment housed there. 
{»& The rooms typically have racks where the data communication and processing equipment 

Til t 

|7is installed. While there are many benefits to having all the equipment in one place — 
2; such as easier access and maintenance — data centers are costly to build and operate. 
^Because of the high cost involved, space in a data center is at a premium, and data center 
20 facility managers try to squeeze as much equipment as possible into every data center. 
To do so, however, data center managers must have an accurate way of assessing the 
power consumption and cooling requirement of each component housed in the data 
center. For a data center, power and cooling are virtually synonymous, since a large 
portion of the electrical power consumed by a device usually ends up converted into 
25 thermal energy. 

A power specification for a computer system, Pmax usually defines 
maximum power capability of the power supply in the system. In the process of 
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determining a value of Pmax, system designers usually consider the worst-case 
configuration of a system. Thus, Pma X for a system represents power consumption when 
the system is fully populated with hardware. The determination of P MAX also assumes 
that the system is configured with the most power hungry components capable of being 
5 used in that configuration, and that the system is running software that causes it to 
consume maximum power. For example, a server system may be designed to support 
four processors that may run at between 1.5 GHz and 2.2 GHz, 12 slots of memory, 8 
slots for input/output (I/O) adapters and 5 bays for hard drives. The P MAX for such a 
system assumes the system is populated with all four 2.2 GHz (max power) processors, 
10 all twelve memory slots, all eight I/O slots populated with power hungry I/O adapters, 
and the system is using five hard drives. 

H* The present methods for determining Pmax suffer from various 

S3 

q disadvantages. First, most systems are populated with less hardware components than 

m 

iTi their capacity. Second, in the vast majority of cases not all the components used are the 
15 : % most power hungry. For example, many systems may be using processors slower than 
A3 2.2 GHz. Slower processors usually consume less power. On average, most of the 
U systems could be consuming power far lower than P M ax> 

Data center facility managers mistakenly interpret Pmax to be the actual 
Q power consumption of the system, rather than the maximum power capability of the 
20 power supply. As a result, data center managers currently use Pmax as a guideline to 
decide the amount of power and cooling they should provide for each rack, and for the 
data center as a whole. For systems that consume less power that Pmax? power delivery 
and cooling solution based upon Pmax may be over-designed and more expensive than 
necessary. Moreover, the philosophy of using Pmax generates demand on infrastructure, 
25 much higher than what would be actually needed. Data centers that use thousands of 
such systems, this could result in much large demand and expense on infrastructure. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Non-limiting and non-exhaustive embodiments of the present invention are 
described with reference to the following figures, wherein like reference numerals refer 
to like parts throughout the various views unless otherwise specified. 

5 Figure 1 A is an elevation drawing of an arrangement of racks typically 

found in a data center. 

Figure IB is an elevation drawing of a typical data center rack and its 

components. 

Figure 2A is a perspective view of a typical computer configuration. 

10 Figure 2B is a table illustrating the determination of maximum power for 

ih- the computer configuration illustrated in Figure 2A. 

I J . Figures 3A and 3B are tables illustrating a first embodiment of the 

PJ invention. 

srs 

Figures 4A and 4B are tables illustrating a second embodiment of the 

8 i i! 
■srsr 

15 « invention. 

! ! f Figures 5 A and 5B are tables illustrating a third embodiment of the present 

W invention. 

0 

f 581 Figures 6A-6C are drawings illustrating various methods of implementing 

the present invention. 

20 DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS 

Embodiments of a system and method for computing power consumption 
for an electronic device such as a computer are described herein. In the following 
description, numerous specific details are described to provide a thorough understanding 
of embodiments of the invention. One skilled in the relevant art will recognize, however, 
25 that the invention can be practiced without one or more of the specific details, or with 
other methods, components, materials, etc. In other instances, well-known structures, 
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materials, or operations are not shown or described in detail to avoid obscuring aspects of 
the invention. 

Reference throughout this specification to "one embodiment" or "an 
embodiment" means that a particular feature, structure, or characteristic described in 
5 connection with the embodiment is included in at least one embodiment of the present 
invention. Thus, appearances of the phrases "in one embodiment" or "in an 
embodiment" in this specification do not necessarily all refer to the same embodiment. 
Furthermore, the particular features, structures, or characteristics may be combined in any 
suitable manner in one or more embodiments. 

10 Figure 1A illustrates one embodiment of an arrangement of a data center 

11. The data center 11 includes a plurality of rack assemblies 10 positioned in rows 

Li, 

q separated from each other by aisles, as well as a plurality of cooling units 22. The racks 
Jj"J 10 are supported on a raised floor 14, which is suspended above the actual floor 18 of the 

W data center. In addition to providing space for cables connected to devices in the racks 

£ 

15 jp 10, the space between the raised floor 14 and the actual floor 18 provides a path for 

03 

7 cooling air to flow from the cooling units 22 to the racks 10. In the data center 11, the 
% '] aisles between racks alternate between hot aisles 24 and cold aisles 26. In the cold aisles 

f* 26, there are gratings or other perforations 20 in the raised floor 14 (see Figure IB) 

yj 

0 surrounding the racks 10, which allows the cool air from underneath the raised floor to 
20 flow near the racks and carry away thermal energy generated by components in the racks. 
Other arrangements of the data center 1 1 are, of course, possible. 

Figure IB illustrates an example of a rack assembly 10 that may be found 
in some data centers. The rack assembly 10 comprises a rack 12, which usually rests on a 
raised floor 14. The rack 12 has a plurality of openings 16 into which electronic devices 
25 can be inserted; devices typically found in the rack 12 include servers, routers, switches, 
instruments, and the like. Typically, the raised floor 14 is separated from the actual floor 
18 of the data center, and will have a series of perforations or other openings 20 around 
the rack so that cooling air flowing between the raised floor 14 and the actual floor 18 
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can flow near the rack and cool the devices in the rack, as shown by the arrows in the 
figure. Other cooling arrangements are also possible. For example, the rack 10 may not 
be on a raised floor, and the cold air may be brought near a rack via ventilation ducts. 

Each rack 12 has both physical limits and power/cooling limits. The 
5 physical limits are relate to the number of openings 16 in the rack; in Figure IB, the rack 
12 can accommodate five devices, although other racks may be able to accommodate 
more or less devices. The power/cooling limits relate to the amount of power that can be 
delivered to the rack, and the amount of cooling air that can be delivered to the rack from 
underneath the raised floor 14. Power and cooling limits are virtually synonymous, since 
10 most of the power delivered to the device as electrical energy ends up being converted 
into thermal energy. For example, the rack 12 may have a physical limit of five devices 
as shown, while having a maximum power capacity of 2000 W, meaning that the total 

£3 

q power consumption of all devices in the rack must be less then or equal to 2000 watts. In 

fji 

p*i some cases, the rack may encounter its power and cooling limits before it encounters its 
15 +; physical limits, meaning that the total power allocation of the rack is used up before its 
03 physical space is. This results in wasted space, which is a disadvantage in application 
U such as data center where space is at a premium. 

H Currently, data center managers put devices into the rack 12 until the 

!,7 : :J 

Q physical or power/cooling limits of the rack are reached. With the increasing 

I?* 

20 " miniaturization of electronics, it is more common to reach the power/cooling limit before 
reaching the physical limit. To determine the power consumption of each device being 
put into the rack, the data center manager usually looks at the size of the power supply 
built into the particular device. The power supplies are usually sized to accommodate the 
maximum power P MAX that the particular device could possibly use. The data center 

25 manager then puts devices into the rack 12 until the sum of the capacities of the power 
supplies of the devices reaches the power and cooling capacity of the rack. 

Figure 2A illustrates one possible embodiment of the internal configuration 
of a computer 30, which is one type of device commonly found in racks at data centers. 
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The computer 30 includes a motherboard 32 having a number of slots thereon, so that the 
elements that comprise a computer can be attached to the motherboard. The motherboard 
32 includes four processor sockets 34 to which microprocessors can be attached, twelve 
memory slots 36 into which memory (e.g., DIMM modules) can be inserted, and eight 
5 input/output (I/O) adapters 38 for receiving a variety of components, such as I/O 
controllers, sound cards, and the like. Additionally, the motherboard 32 can support as 
many as five hard drives 48, which would be housed in five hard drive slots 40 found in 
the system chassis. 

Figure 2B illustrates the determination of P MAX for the computer 30 shown 
10 in Figure 2 A. As shown, P MAX is determined by assuming that the motherboard is fully 
populated with components, and that each component was the most power-hungry 

^* component of its type. The vast majority of computers do not, however, have a fully 

fi 

g populated motherboard; instead, only selected components are usually present. In Figure 
2A, the motherboard has sockets 34 for four processors, but only two processors 42 are 
15 HF present. Likewise, the motherboard has space for eight I/O adapters, but only three I/O 
83 adapters 44 are present; it has space for twelve memory modules, but only six modules 46 
m are present; and it can support as many as five hard drives, but only two hard drives 48 
|^are presently connected to the motherboard and housed in the drive slots 40 of the system 
Ifchassis. Moreover, the actual configuration often does not include the most power- 
20 ihhungry components. Thus, in most cases, the calculated power consumption P MAX of the 
computer far exceeds its actual power consumption because of the assumed presence of 
components that are not there. 

Figures 3A and 3B together illustrate a first embodiment of the present 
invention. Figure 3A illustrates the embodiment in general terms, while Figure 3B 
25 provides a prophetic example for a case where the device is a computer. Figure 3A 
tabulates the elements of a device that includes J different types of components. For each 
component j (/=1 to J), Figure 3 A lists the quantity qj of that particular component found 
in the device, the power consumption pj of each component, a de-rating factor Dj and a 
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voltage regulator (VR) efficiency Ej. For each component j\ the power pj is the actual 
power consumption of the component, rather than the power consumption of the most 
power-hungry version of that component. Some system components may use a voltage 
regulator, VR, that steps down voltage provided by a system power supply to a voltage 
5 that is acceptable to the component. The de-rating factor Dj attempts to account for less 
than full-time use of each component, while the VR efficiency Ej accounts for the 
efficiency of the voltage regulator, if present. The de-rating factor Dj and efficiency Ej 
generally have values between 0 and 1, including 0 and 1. The de-rating factor is a 
subjective number usually chosen by the power system designer based on his or her 
10 experience, and possibly some other empirical factors. It is not an analytically 
determinable number, nor will it be the same for every power system design. 

if The first step in computing the power consumption of the device described 

Q in Figure 3A is to compute the power consumption of each component / To do so, for 

jrj ji 

jry each component/ the power pj is multiplied by the de-rating factor Dj t and this quantity is 

l5p then divided by the VR efficiency Ej. The resulting quantity is then multiplied by the 

£ J actual quantity g y of that particular component found in the device. This operation is 

h* carried out for each component in the device, and then the resulting quantities are 

m 

U summed to obtain the total power consumption Pconfig of the configuration as follows: 

y 

f 1 j n D 

?: P =y a ( Pj J ) 

f s 1 CONFIG Z~i^j^ 77 ' 

20 This formulation of Pconfig defines the power consumed by the system as it 

is configured, rather than the power Pmax consumed in the worst-case scenario. P M ax 
indicates what system is capable of when populated with power hungry hardware running 
power hungry software. But using Pmax creates excess demand for power and cooling 
infrastructure, and thus results in less usable space in rack at data centers, higher demand 

25 for power and higher cost. Since Pconfig represents actual power that can be consumed 
by systems, this will help user more accurately allocate and budget more realistic number 
for the infrastructure. In most cases Pconfig will be lower that Pmax, so data center 
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managers can realize substantial savings, both in cost and space, by using Pconfig instead 
of Pmax- 

Figure 3B illustrates a prophetic example of the embodiment illustrated in 
Figure 3 A, using as an example the computer described in Figures 2 A and 2B. This 
5 example assumes that the component actually chosen for use in the computer would have 
power consumptions in the middle of the ranges shown in Figure 2B. Applying the 
embodiment described in Figure 3 A, power consumption for the given configuration, 
Pconfig tarns out to be 163.7W. This is substantially less than the 553. 5W which would 
result if the maximum of each configuration were used as shown in Figure 2A. This 
10 lower and more accurate power consumption translates directly into savings in power and 
cooling for data centers. 

Figures 4A and 4B together show a second embodiment of the present 
|3 invention. The approach of this embodiment differs slightly from the approach of the 
P J first embodiment. In this embodiment, the actual power consumption of the component 

15 is used for components whose power consumption exceeds a certain threshold power, 

IB 

~" whereas the power consumption of the most power-hungry component is used for those 
components whose power consumption falls below the threshold power. For instance, in 
a computer configured to use 4 I/O cards and a processor between 1 GHz and 3 GHz, this 

O approach would use the actual power consumption of the processor in the system (which 
20 tends to consume significant power), while using the power consumption of the most 
power-hungry I/O cards (which tend to consume less significant power). 

Figure 4A illustrates this embodiment in general terms, while Figure 4B 
provides a prophetic example for case where the device is a computer. Figure 4A 
tabulates the elements of a device with J components. For each component j (/=1 to J), 
25 the table lists a quantity q jf which is the number of that component found in the device, as 
well as a de-rating factor D h and a VR efficiency Ej. For ease of illustration the 
components have been segregated, such that for components from 1 to j, the actual power 
consumption pj is used. For components j+1 through J, the maximum power P( max )j is 
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used Thus, in this embodiment, in contrast to the previous embodiment, the total power 
consumption is computed using the actual power consumption of some components, 
while using the maximum power consumption for other components. Usually, the 
maximum power consumption will be employed for components that have lower relative 
5 power consumption, such as I/O adapters. 

To determine the overall power consumption of the device, the power 
consumption for each component (whether it be the actual power or the maximum power) 
is multiplied by the de-rating factor D jf and the resulting number is divided by the 
efficiency Ej. The resulting quantity is then multiplied by qj to account for the number of 
10 any given component. As before, once the power consumption for each given type of 
component found in the configuration is computed, the overall power consumption of the 

H configuration, Pconfig, is computed as follows: 

fi 

1 « P CONFIG = Zj 4 J + lu 1} ( p ) 

fj M h j 7=7+1 &j 

4; This formulation of Pconfig does not define the power consumed by the 

to 

15^ system exactly as configured, but still provides a more accurate approximation than the 
ry power Pmax consumed in the worst-case scenario. Since Pconfig determined this way is 
closer to the actual power that can be consumed by systems, this will help user more 
p accurately allocate and budget more realistic number for the infrastructure. In most cases 
this Pconfig will still be lower that Pmax, so data center managers can realize substantial 
20 savings, both in cost and space, by using this Pconfig instead of Pmax- 

Figure 4B provides a prophetic example of this embodiment using the 
configuration of the computer described in Figures 2 A and 2B. This example assumes 
that the component actually chosen for use in the computer would have power 
consumptions in the middle of the ranges shown in Figure 2B. The threshold power is set 
25 at 40W: for components with power consumption below 40W, the maximum power 
consumption is used, while for components with a power consumption at or above 40W, 
the actual consumption is used. Applying the embodiment described in Figure 4A, power 
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consumption for the given configuration, P C onfig turns out to be 236. 1W. This is 
substantially less than the 553. 5 W which would result if the maximum of each 
configuration were used as shown in Figure 2A. This lower and more accurate power 
consumption translates directly into savings in power and cooling for data centers. 

5 Figures 5A and 5B together show a third embodiment of the present 

invention. The approach of this third embodiment is identical to the approach of the first 
embodiment, except that the overall power consumption is multiplied by a "safety margin 
factor" (3 which, like the de-rating factor Dj and efficiency Ej , will usually be a subjective 
factor applied by a designer, depending on their level of comfort with the computed 
10 power consumption. 

Figure 5A illustrates the embodiment in general terms, while Figure 5B 
|h provides a prophetic example for case where the device is a computer. Figure 5A 
^ describes the device with J components. The variables associated with each element / 
W through J are defined similarly to those in the first embodiment. As in the first 
15JS embodiment, the first step in computing the power consumption of the device described 
in Figure 5A is to compute the power consumption of each component j. To do so, for 
j„J each component j the power p } is multiplied by the de-rating factor D j? and this quantity is 
\\ then divided by the VR efficiency Ej. The resulting quantity is then multiplied by the 
O actual quantity qj of that particular component found in the device. This operation is 
20 carried out for each component in the device, and then the resulting quantities are 
summed to obtain the total power consumption of the configuration. Pconfig for the 
configuration is then determined by multiplying the power consumption by a safety 
margin factor p as follows: 



Pconfig ~ P 



>1 E j 



25 As with the second embodiment described above, this formulation of 

Pconfig does not define the power consumed by the system exactly as it is configured. It 
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does, however, provide a more accurate approximation than the power P M ax consumed in 
the worst-case scenario. Since Pconfig determined this way is closer to the actual power 
that can be consumed by systems, this will help user more accurately allocate and budget 
more realistic number for the infrastructure. In most cases this Pconfig will still be lower 
5 that P M ax> so data center managers can realize substantial savings, both in cost and space, 
by using this Pconfig instead of Pmax- 

Figure 5B provides an example of the embodiment shown in Figure 5A 
using the computer configuration described in Figures 2 A and 2B. This example assumes 
that the component actually chosen for use in the computer would have power 
10 consumptions in the middle of the ranges shown in Figure 2B, and that the safety margin 
factor p has a value of 1.1. Applying the embodiment described in Figure 5A, power 
consumption for the given configuration, Pconfig tunis out to be 180.1W. This is 

S3 

Q substantially less than the 553.5 W which would result if the maximum of each 
fQ configuration were used, as shown in Figure 2A. This lower and more accurate power 
151" : consumption translates directly into savings in power and cooling for data centers. 

7 Figures 6A-6C illustrate ways in which Pconfig can be communicated to, 

p and implemented by, data center managers. The benefits of determining a more accurate 

f * power consumption using one of the above embodiments will not be realized unless the 

W 

O actual power consumption is communicated to the data center facility manager, so that 
20 they can take the actual power consumption into account when they place devices in a 
rack, and decide how many racks can fit in a data center. Figure 6A illustrates one 
embodiment in which the actual power consumption of the configuration (Pconfig) can be 
computed, printed on a label 50, and the label can be put on the outside of the cabinet 52 
of the device at the time of manufacture. That way, once the data center facility 
25 managers get the device, they know the power consumption immediately from the label. 

Figure 6B illustrates another embodiment in which the embodiments of 
Pconfig described above could be implemented in software resident on the device itself. 
Thus, for example, the computer 52 could have software thereon that would analyze the 
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system, determine the exact configuration, and then use that information to compute the 
actual power consumption of that particular configuration. The result would be 
transmitted to a display 54 for the data center facility manager to see. 

Figure 6C shows yet another possible embodiment in which the software to 
5 compute the power consumption of the configuration could be put on a website resident 
on a server 56. The web site would be accessed by a facility manager via a network 58 
(e.g., the Internet). The facility manager would input quantity and type of some or 
components to the web site, which would then analyze the configuration, compute 
Pconfig? and return the value on the website or to the computer 52 via the network 58. 
10 The computer 52 would then display the value on the display unit 54. Computer 
manufacturers often consider information on de-rating factors and VR efficiencies to be 

I** proprietary and confidential. One advantage of the web site approach would be that it 

u 

p allows a manufacturer to provide accurate power consumptions to its customers while 

jij 

U] maintaining the confidentiality of the manufacturer's information. 
154; In another possible embodiment, the embodiments of Figures 6B and 6C 

a j 'i 

could be combined, such that there would be a piece of software resident on the computer 
itself which would analyze and determine the number and type of components in the 
H computer 52, and then automatically contact the website 56, to which it would send the 
O information regarding the configuration. The website would then return a number that 

|ssa 

20 " represents the actual configuration power consumption. 

The above description of illustrated embodiments of the invention, 
including what is described in the Abstract, is not intended to be exhaustive or to limit the 
invention to the precise forms disclosed. While specific embodiments of, and examples 
for, the invention are described herein for illustrative purposes, various equivalent 
25 modifications are possible within the scope of the invention, as those skilled in the 
relevant art will recognize. 

These modifications can be made to the invention in light of the above 
detailed description. The terms used in the following claims should not be construed to 
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limit the invention to the specific embodiments disclosed in the specification and the 
claims. Rather, the scope of the invention is to be determined entirely by the following 
claims, which are to be construed in accordance with established doctrines of claim 
interpretation. 



IMS? 
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